Maximum Smoothed Likelihood Estimation
نویسندگان
چکیده
Looking myopically at the larger features of the likelihood function, absent some fine detail, can theoretically improve maximum likelihood estimation. Such estimators are, in fact, used routinely, since numerical techniques for maximizing a computationally expensive likelihood function or for maximizing a Monte Carlo approximation to a likelihood function may be unable to investigate small scale behavior of the likelihood. A class of maximum smoothed likelihood estimators is introduced and shown to be asymptotically efficient for models possessing local asymptotic normality. This theoretical result corresponds to good finite sample properties in two examples, with a likelihood that is smooth but multimodal, and a likelihood that is not smooth.
منابع مشابه
Smoothed log-concave maximum likelihood estimation with applications
We study the smoothed log-concave maximum likelihood estimator of a probability distribution on Rd. This is a fully automatic nonparametric density estimator, obtained as a canonical smoothing of the log-concave maximum likelihood estimator. We demonstrate its attractive features both through an analysis of its theoretical properties and a simulation study. Moreover, we use our methodology to d...
متن کاملA Universally Consistent Modification of Maximum Likelihood
In some models, both parametric and not, maximum likelihood estimation fails to be consistent. We investigate why the maximum likelihood method breaks down with some examples and notice the paradox that, in those same models, maximum likelihood estimation would have been consistent if the data had been measured with error. With this motivation we define doubly-smoothed maximum likelihood as a n...
متن کاملGeneralized continuous isotonic regression
The standard isotonic regression of a vector in IRn is the solution to a least squares projection problem on the cone C of vectors with ‘increasing components’ in IRn. Generalized isotonic regression problems are isotonic optimization problems that seem to be quite different from isotonic regression problems, but in fact have the same solution. In problems of maximum smoothed likelihood estimat...
متن کاملEfficient Estimation for an Accelerated Failure Time Model with a Cure Fraction.
We study the accelerated failure time model with a cure fraction via kernel-based nonparametric maximum likelihood estimation. An EM algorithm is developed to calculate the estimates for both the regression parameters and the unknown error density, in which a kernel-smoothed conditional profile likelihood is maximized in the M-step. We show that with a proper choice of the kernel bandwidth para...
متن کاملInitializing normal mixtures of densities
It is well known that log-likelihood function for finite mixtures usually has local maxima and therefore the iterative EM algorithm for maximum-likelihood estimation of mixtures may be starting-point dependent. In the present paper we propose a method of choosing initial parameters of mixtures which includes two stages: (a) computation of nonparametric optimally smoothed kernel estimate of the ...
متن کامل